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Abstract. We construct an independent increments Gaussian process associated to a 
class of multicolor urn models. The construction uses random variables from the urn 
model which are different from the random variables for which central limit theorems 
are available in the two color case. 
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1. Introduction 

Consider a four-color urn model in which the replacement matrix is actually a stochastic 
matrix R as in ref. [4]. That is, we start with one ball of any color, which is the 0-th 
trial. Let W„ denote the column vector of the number of balls of the four colors up to 
the n-th trial, where the components of W„ are nonnegative real numbers. Then a color is 
observed by random sampling from a multinomial distribution with probabilities (l/(n -h 
1))W„. Depending on the color that is observed, the corresponding row of R is added 
to Wj, and this gives A special case of the main theorem of Gouet [4] is that 

if the stochastic matrix R is irreducible, then (l/(«-f l))Wj, converges almost surely 
(a.s.) to the stationary distribution n of the irreducible stochastic matrix R (it should be 
carefully noted that the multicolor urn model is vastly different from the Markov chain 
evolving according to the transition matrix equal to the stochastic matrix R, also notice 
that TT is a row vector). Suppose the nonprincipal eigenvalues of R satisfy Ai < 1/2, A 2 = 
1 / 2 , A 3 > 1/2 respectively, which are assumed to be real (and hence lie in (— 1 , 1 )), and 
be the corresponding eigenvectors. Using = ttR^; = it is seen that 

(l/(n+l))w;,^,^0. 

Central and functional central limit theorems for have been the subject of sev¬ 
eral papers in the literature [2,3,7] especially for two-color models and also some mul¬ 
ticolor models. The norming in the central limit theorems in the two color urn mod¬ 
els depends on the nonprincipal eigenvalue as follows: for A < 1/2 the rate is ^/n, for 
A = 1/2 the rate is v/nlogn and the limits are normal in these two cases. However 
for A > 1/2 the rate is nQ^'(l -f (A/(/-f 1 )) and in this case the limit exists almost 
surely. 

Functional central limit theorems (FCLT) for a class of two-color urn models have 
been considered by Gouet [3]. These FCLT’s of Gouet [3] use the same norming, 
as stated in the previous paragraph, under which central limit theorems have been 
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proved in [2] and [3]. Ref. [5] contains a survey of the literature on such FCLT’s. In 
this article we prove a different FCLT that uses random variables with the norming 
nQ^^(l + (X/{j + 1)) irrespective of whether X is less than 1/2, equal to 1/2 or greater 
than 1/2. This is the main result of the paper. For the sake of convenience we restrict 
ourselves to real eigenvalues only. We state the result for the above four-color model but 
it can be seen from the proof that it can be extended to urn models with any number of 
colors. 

The article is organized as follows. In §2 we develop the notation, state the main 
result and give its proof. Some of the calculations have been done separately in 

§3. 


2. Main result 

We write 



where ^ is the eigenvector corresponding to the eigenvalue Xi. From the description of 
the urn model we have + XiX'„+i^i, where Xn+i is the 

column vector consisting of the indicator functions of balls of the four colors respectively. 
We also have 

E{x'„+i^.m = ( 2 ) 

where is the a-field of observations up to the n-th trial. From this it follows that Z, „ is 
a martingale. From §3, it follows that Z 3 „ is L^-bounded so that it converges almost surely. 
However in the two color case, for X < 1 / 2 , /-y/n and for X = 1 / 2 , /^/nlogn 

converge to normal distributions and the FCLT’s proved in [3] use such normalizations. 
Thus the question of using the same norming nQ^^(l + (A/(/ + 1)) ~ n'^, to get an 
FCLT irrespective of A < 1/2, A = 1/2 or A > 1/2, is of interest. Our main result. 
Proposition 2.1, is a step in this direction using the tails of the sequence (Zp„,Z 2 ,„,Z 3 _„) 
whereas the FCLT’s in the literature are based on partial sums starting from the 
beginning. 

PROPOSITION 2.1. 

The sequence of processes G„(f) = (Gp„(t),G 2 ,n(f),G 3 ^„(f)) where 
[««'] 

Gi,n{t) = Yj i = 1,2,3, f > 0, 

m=n 

converges to an independent increments Gaussian process G{t) with covariance function 
= tXiXj{^i^j,n')f,j = 1,2,3, where the vector of the coordinate-wise product of 
the components of the two vectors and is denoted by and the Euclidean inner 
product of the two vectors is denoted by (.,.). 

Note that the process G can be viewed as a multidimensional Wiener process with covari¬ 
ance function Cij{-). 



Afunctional central limit theorem for a class of urn models 


495 


Proof From eq. (1) we have the following expansion; 


y _ y _it 


n' 


-^‘z- 

m 


k=0 




(3) 


Since the components of G„(f) are martingales, an independent increments Gaussian pro¬ 
cess as a limiting process is expected. In particular we follow Theorem 1.4, p. 339 of [1], 
by which it is enough to show that the joint characteristics of the martingales converge 
to a joint covariance function. Note that from (3) (Z, „,+ i — 2,-,^) = 0{l/^/m), as 

Wm ^i/m and xL+i^i bounded. This takes care of continuity of the paths and cross 
quadratic variations which is condition (b) of that theorem. Thus it remains to show that 
the cross quadratic variations converge to Cij {t). We first do this for i=\,j = 2. From (3) 
we have 

-Zi,„) ~ ( 4 + 1^0 

m^2+^ 

We want to show that in computing the cross quadratic variation, which is the limit of 


[««'] 

^ £{m^‘-'/2m^2-l/2(Zi,^+l -Zi,^)(Z2,™+l -Z2,,nWm}, 


only the second term from the right-hand side of each of eqs (4) contributes. Since Xn+i 
consists of indicator functions, which implies that 



— '^^l,k^2,kZn+l,k, 
k 


this contribution is the limit of 



’ m -f 1 


which is fAiA 2 (<^i^ 2 ) tt'), since from [4] we know Wj„/(m -f 1) ^ ;r a.s. Also notice that 
this part of the argument does not depend on whether X\ or X 2 are less than or equal to 1/2. 

To see why the contribution to the cross quadratic variation from the first terms of (4) 
goes to 0, by Cauchy-Schwarz inequality it is enough to show that the sum of squares 
over n to [nf] of the first terms in each line of (4) goes to 0. This part of the argument will 
depend on the value of Xi. Note the following which have been proved in §3: 

For Ai < 1/2, is L^-bounded, (5) 

s/m 

For ^2 = 1 /2, 

s/mlogm 
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Consider the case Xi < 1/2. We need to show 


We know that for Ai < 1/2, / y/in is -bounded, so that 

WtO Wl-^ 


( 7 ) 


Since the sum inside the expectation in the middle is decreasing in n, it converges to 0 a.s. 
For A 2 = 1 /2, !^/ni\ogm is -bounded, and one can proceed similarly. Thus we 

have proved that ci 2 (f) = tXiX 2 {^\^ 2 ,'^')■ Similarly = 1,2, can be computed 

as given in Proposition 2.1. 

Now consider as to what will happen if we were computing say cp 3 (f). For A 3 > 1 /2, 
the expansion (4) is similar, and in the cross quadratic variation the contribution of the 
second term from the right-hand side of 

m^3-l/2(Z3 _Z3 ) ^ -1/2^ -1/2 iXm+l ^3) 

is similar to what we had before. For A 3 > 1 / 2 , W/,^ 3 /nr'(l + (A 3 /(; + 1 )) is a mar¬ 
tingale and from Appendix 3.3, 

is L^-bounded. ( 8 ) 

So W /,^3 /m '^3 converges almost surely. This implies that the contribution of the first term 


„ m22-3 m2^2A3 


0 a.s. 


since 2 A 3 < 2 . Thus ctj (f), / = 1,2,3 ,7 = 3, can be computed as given in the statement of 
Proposition 2.1. This completes the proof. □ 


3. Appendix 


Suppose real eigenvalues satisfy Ai < 1/2, A 2 = 1/2, A 3 > 1/2 and <^i,^ 2)^3 be the corre¬ 
sponding eigenvectors. In this section we prove that T„ and Z„ are L^-bounded where 


X„ = 




Yn = 


3 /nlogn ’ 


= 


W'^3 


TT«-1 / 1 I _A3_'' 
0 + ,/+l J 


(9) 


a fact which has been used in the proof of Proposition 2.1. For and Y„ verification of L^- 
boundedness is through Lemma 2.1 of [ 6 ]. This is done on a case by case basis depending 
on Ai and A 2 in the next two subsections. For the reader’s convenience we state Kersting’s 
lemma from [ 6 ] here: 


Lemma 2.1.[6]. Let (Xn,^n {n> 1) be nonnegative numbers such that an 0, Y^=\ (Xt = 
00 , and for large n, 

(i dan 

with c,d >0. Then lim sup„_,„„ j3„ <dlc. 
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3.1 -boundedness of Xn 

Using W' 1*^1 and the definition ofX„, we get 


— ^n\ 


n + 1 Vn + 1 


Taking conditional expectation and using (2) we get 

from which taking further expectation we get 


Exf, = ex: 1 - 


n + 1 \ n + 


/.w„ 




"V «+l/ V «+iy n + 1 \ n+l’"V 

The last vector E (W„/(n + 1)) consists of bounded components. Thus if Ai < 0, then 


EX^+,<EX^{1- 


n + 1 / n + 1 


and Kersting’s lemma applies. If >0 then we still have Ai < 1/2 i.e. 2Ai < 1. In this 


2Ai 1 
n + I n + I 


I-2Ai 

n + 1 ’ 


i.e. Kersting’s lemma applies. 
3.2 -boundedness of Yn 


Using W' [(^2 = W /(®2 + ^ 2 Z'n +\^2 and the definition of T„, we get 


Yn+\ — Yyi\ 


niogn 




(n + l)Iog(n + l) i/(« + l)log(n + l)' 


Taking conditional expectation we get (recall A 2 = 1/2) 


wlogw A _1_ 

(n + l)log(n + 1) \ n + 1 


E{Yj+,\^n} = Yl 


(n + l)log(n + 1) \ n4-1 
from which taking further expectation we get 


£T„^+i=£T„‘^ 1 - 


2 / (n +l)log(n +1)-nlogr 
’ V (n + l)log(n + 1) 


/p W„ 2\ 

(n +l)log(n +1) \ n+1 ’^^/' 
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The vector E^Wn /(n + 1)) consists of bounded components. Now we apply the second 
trick of the previous subsection to apply Kersting’s lemma. The following calculation 
does the rest of the work. 

We show that 


(n + l)log(n + 1) 


(n +l)log(n +1) — nlogn 1 


(n +l)log(n +1) n+1 

We approximate log(n + 1) by logn + i. This gives 


c> 0. 


(n + l)log(n + 1) — nlogn ~ (n + l)logn + (n + 1)-nlogn 

n 


Hence 


= log n+1 


1 


logn + 1 +- -log(n + 1) ~ logn + 1 + - - logn + - 1- 


1 


3.3 -boundedness of Z„ 


The proof follows Lemma 3.1 of [2]. We have earlier proved the approximation 

ry ry ^ Xn+1^3 

n 

Now with the martingale property of Z„, Z„+i = Z„ + (Z„+i —Zn), and by the above 
approximation we have 

A-o _ A<o 


£(z2+i |^„) ~ z2 + I 


implying 


EZ, 


H+l 


<£Z„" l--f +A; 


, const 


( 10 ) 


Since 2 A 3 > 1, by iteration of (10) it follows that Z„ is L^-bounded. 
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